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100 

MAIN WORKFLOW 



101 

User Takes 
Picture on the 
Camera 



102 

User Opens an image 
on the PC 



104 

Open a collection on a 
digital printer 



103 

User Opens a folder of 
image on the PC 




110 

For each image in 
the collection 




300 

Correlate Map and 
to Shooting 
Conditions 




132 

NO DUST MAP EXISTS 



Figure 1 
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400 
Delect and 
Remove Dust 
spec 
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230 

Sample Images in 
a sequence to 
create an image 
schedule 



260 

For each Image fl) 
in the schedule 



MULTPLE IMAGES 
t 



250 
Schedule = 
number of images 



300 
Correlate Map 
and to Shooting 
Conditions 




SINGLEIMAGE 
I 



296 

Cluster Dust Pixels 
into Dust Specs 



Continue loop for each image 



270 

If all dust regions have p(Hdp) 
and 

all non dust regions have p(Ndp) 
and all image is covered 



-NOTYET- 



282 

Mark regions with 
high probability as 
non dust (ND) 



292 
Mark regions 
potentially dust 
(YD) 



271 
Continue 



284 
Add non- dust 
regions to the map 
based on f(ndp) 



294 

Add dust regions 
to the map based 
on f(hdp) 



YES 



272 
Alternative 



273 
Continue 



296 

Cluster Dust Pixels 
into Dust Specs 




Figure 2A 
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Exit and return in case 
of a single image 
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1210 

Preparation of Dust Map pM 



1214 

Create NEW pM 
with all pixels 
(x,y) = WHITE 




1216 
Open pM 



1296 

CREATE TRINARY DUS MAP l-pM 
AFTER ClUSTERING 

1232 



For All Pixels (x,y) in l-pm 



1234 

if »-pM(x y) E DUST_REGION l-pM(x.y) = DUST 
l-pM(x.y) E LARGE_REGION l-pM(x.y) = MAYBE 
l-pM(x,y) = WHITE_PIXEL l-pM<,y) = WHITE 



1233 
Continue 



1250 

CREATE BINARY DVS MAP pM 



1252 
For All Pixels 



i 1 

(x,y) indM I 




1256 
pM (x,y) = YES 



C 



1253 
Continue 



1299 
Exit 



D 



300 
Correlate Map 
and to Shooting 
Conditions 



1220 

CREATE TRINARY DUS MAP l-dM 



{ 1222 ] 

H For All Pixels (x.y) in I j 



1224 



Case 

Luminance(l(x,y)) 

< DARK_THRESHLOD 
> WHITE_THRESHLOD 
OTHERWISE 



1-pM (X,Y) = MAYBEDUST 
l-pM(x,y) = WHITE PIXEL 
l-pM(x.y) €>ONT KNOW 



1223 
Continue 



1240 

CREATE CONTINUOUS DUST MAP dM 



1242 
For All Pixels 



(x.y) in l-pM 



276 
CASE: 

l-pM(x,y) = DUST_REGlON 



l-pM<x.y) = WHTE 



l-pM(x.y) = MAYBE 



1294 

dM(x.y) = -=QUANTA 



1284 
dM(x,y) = WHTE 



1244 

dM(x,y) = Unchanged 



1243 
Continue 



Figure 2B 
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300 

Correlate Map and 
to Shooting 
Conditions 



304 
Load 
image Header ! 
I 




112 
Load 
Dust Map 
pM 



320 
Extract 
Shooting 
Parameters 
From Image 



310 
Extract 
Shooting 
Parameters 
From Map 



328 
Extract Image 
Apperture 



326 
Extract Image 
Lens and Focal 
Length 



318 
Load Camera 
distance of 
dust to sen sor 



312 

Load Dust Map[ 

Lens and 
Focal Length 



314 

Load Dust Map| 
Aperture 



900 
Adjust 
Dust map 7 Image 
Based on Focal Length 




800 

Adjust Dust Map / 

Image 
3ased on Apertu r 



Figure 3 




398 

Return to main with 
correlated dust map 
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410 
For Each Dust 
Spec in cM 



/ 420 x 
For Each Pixel 
where 
OPACITY < FULL 



500 

Perform Quality 
Control for a 
single Pixel 



ir ▼ 

430 






432 


Enhance image 






l'(x,y) = l(x,y)/ 


degradation 






OPAQTY 



Continue 

loop 

for 
each 
Dust Spec 



/ 440 \ 
For region area 
where Opacity = 
FULL 
(O(x.y)) 



450 
In-Painting 
.reconstruction/ 




500 

Perform Quality 
Control for a 
single Pixel 



anujjuoo 
IZV 



End of aperture 
correction 



Figure 4A 
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450 
In-Panting 
reconstruction 



451 
Input: 
region area 
where Opacity = FULL 
(0(x,y)) 



480 

For each pixel (l.j) 
in 0(x,y) 



1 


r 


482 
Apply a new 
value based on its 
surrounding pixels 


i 


f 



489 
Continue 



/ 460 x 
For each pixel (l,j) 
in the periphery of 
0(x,y) 



462 
Define the 
Gradient for (i,j) 



/ 470 \ 
For each pixel (k,l) 
in the Inner 
boundaries of 
0(x,y) 



472 

Find the pixel 
(m,n) surrounding 

(k,l) with the 
smallest Gradient 



474 
Apply 
KW> = 

L2||(m,n),(k,l)irGrad(l(k.l)) 



Figure 4B 



476 

Remove (k.l) from 0(x,y) 



479 
Continue 
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Figure 4D 
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Figure 4E 
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Figure 4F 
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500 

Perform Quality 
Control of Dust Map 




/ 510 \ 
For all pixels in 

Imagel 
corresponding to 
the dust mapdM 



300 

Correlate Map and 
to Shooting 
Conditions 




520 
Find 
Corresponding 
region in the image 




Figure 5 
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Figure 6A 





L— — ==ri 


Lens 2 










Fiaure 6B 









Lens 3 










Figure 6C 
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Secondary pricipal 
plane 



642 

Exit pupil distance 
K 1 




644 
\ 

Focal distance 



Figure 6D 
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hO h 



Pe 



k- 



Figure 6E 
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Figure 7A 
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Figure 7B 




Figure 7C 
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Figure 7D 




Figure 7E 
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Figure 7F 
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800 

Adjust Correction 
Map filter based on 
Apperture 



326 
Extract Image 
Aperture 
information 



312 
Load Apert ure 
data form Dust 

Map 



810 

For Each Dust Spec in the Map 



820 

Calculate the size of 
the focus-spill 



n 



830 
Create a fully 
shadowed Dust 
Spec 



840 
Create a semi 
opaque dust spec 



/ 832 \ 
For each pixel in the 
fully shadow ed 
region 




For each pixel in the 
semi opaque region 



834 
Assign 
opacity=FULL 



844 

Calculate opacity 
function value 



835 
Continue 



841 
Continue 



1 


I 


811 

Continue 


) 



Figure 8 
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900 

Adjust 
Dust map' Image 
Based on Focal 

Length 



326 
Extract Image 
Focal Length and 
lens type 



312 

Load Dust Map [ 
Focal Length 
and lens type 



318 
Load tw 
distance of 
dust 



/ 940 
For each Pixel in the I 
Peripheral of the Dust 
Spec 



910 

For Each Dust Spec in the Map 



920 

For each Pixel in ti 
Dust Spec 



942 

Load the X.Y coordinates in 
relations to the Center of the Image \ 



. 944 

Calculate Dust shift on the Axis to the 
origin 



922 

Load the X,Y coordinates in 
relations to the Center of the Image \ 



Calculate Dust shift on the Axis to the 
origin 



941 
Continue 



921 
Continue 



911 




Continue 





Figure 9 
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1010 
Acquire Image 11 



1012 

Detect Dust Map with 

Regions Dn(lj) 
each centered at (ij) 



1020 

Repeat until image with 
clear dust spots is captured 



1030 
Acquire Image In 
with differe nt focal lens 
parameters 



1040 

Repeat until D'n(lj) is a clear 
dust spot in Image 12 



1042 
Within (ij) region 
correlate Dust region Dn*(l\j') with 
Dust spot Dn(ij) 



1049 
Continue 



1050 
Calculate the ratio 
i/i' and jf 



Figure 10 
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1110 
Acquire Image 11 



1120 

Detect Dust Map with 

Regions Dn(lj) 
each centered at (i,j) 



' 1130 
Repeat for several apertur es 

and image with 
clear dust spots is captured 



1140 
Acquire Image In 
with different aperture 



1150 

Repeat until D'n(l j) is a clear 
dust spot in Image 12 



1160 
Within (i,j) region 
correlate fall off in Dust region 
Dn'O'j*) with Dust spot Dn(ij) 



1170 

For each pixel (k,l) in Dust spec 
Dn 



1172 

Calculate the ratio of D(k,l) and 
Dn(k,l) 



1168 
Continue 



1169 
Continue 



1179 
Continue 



1180 

Determine Fall off as a 
function of ape rture 



Figure 11 
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1200 
Input: 
Dust Map 



1210 

Determine the need to perform 
maintenance analysis 



f 1212 \ 
*\ No Need J 



1220 
Anafyze dust map 






1290 
Inform user that 
camera needs to be 
maintained 




1285 
Inform user of the 
need to create a 
new calibra tion 
image 



1130 

Repeat for each dust region in 
dust map 



1140 
Calculate 

- Area of dust r egion 

- Maximum width of dust region 

- Distance between dust region and 

neighboring regions 

- movement of dust region form last analysis 

- occurrence of dust form last an alysis 



1146 

Continue 



1150 

Consolidate the results of each dust region for the 
entire image: 

Calculate: 

- Overall area of dust 

- Largest width of dust 

- Largest area of d ust spec 

- changes in area of dust since last analysis 

- Changes of dust particles since last analysis 



Figure 12 



